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DETAILED ACTION 

Remarks 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
fortfi in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .1 7(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 

31 1201 1 has been entered. 

2. Applicant canceling claims 1 1 and 1 2 is acknowledged. 

3. Claims rejections under 35 USC § 1 02 are withdrawn in view of the amendment. 

Response to Arguments 

4. Applicant's arguments with respect to claims 1 , 3-1 0, and 1 3-1 5 have been 
considered but are moot in view of the new ground(s) of rejection. 



Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as 
set forth in section 102 of t9333his title, if the differences between the subject matter sought to be 
patented and the prior art are such that the subject matter as a whole would have been obvious at 
the time the invention was made to a person having ordinary skill in the art to which said subject 
matter pertains. Patentability shall not be negatived by the manner in which the invention was 
made. 

5. Claims 1 , 3-4, 8, and 1 1 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Gomila et al. (C. Gomila and A. Kobilansky, "SEI message for film 
grain encoding", document JVT-H022, JVT of ISO/IEC MPEG & ITU-R VCEG, Geneva, 
Switzerland, May 23-27, 2003) in view of Admitted Prior Art ("APA" hereinafter, 
"decoder 12" described In page 5: line 18 to page 6: line 4 of specification; also see 
"decoder 12 takes the form of a H.264 decoder known in the art" in page 5: lines 22-23) 



Reaardino claim 1 . Gomila et al. disclose a method for reducing artifacts in a video 

stream (page 2, lines 5-21 ; Examiner notes that the artifacts are the missing film grain in 



the decoded images because as described in page 3 - emphasis added: 



sis-isjeg^ reqii'f es me «<r50ocS©t' ttt pm^mMmm m im p3«f» of lite m^im sm^iimm mm m& 
:o ^-n>u^gfe fho U^n r^^atr^ <^cwtef*3 ^.d a pr^^^fj^cr mtmi To ^compNsh the Wn ^mi'^ 

by ^&<vo,if^9 tvf<>cess (f jfijfe 2) Mote ih»j ^tm^y x^mi^^^^t-tki -a m ^^«ax3©f non> 



i.e., the disclosed method by Gomila is well suitable for reducing artifacts), comprising 



the steps of: decoding the video stream (Figure 1" "Decoding"); and adding random 



noise (page 5:, equation (2) where "N is a random value" in page 5: line 35) to at least 



one pixel in a picture in the video stream following decoding (Figure 1 , "Film grain 
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simulation"; page 3: line 27 "film grain simulation (decoder)" section) in an amount 
correlated to luminance information of at least a portion of a current picture (page 5 - 



emphasis added: 



in 3 ifrst approach, we propose {o use «ecx»nd order auto negressioo jo macJ^i spatsas correlation ao<f 
rtrst order rsgresston in moQai crcss-coJor and te^pofal correSattomi. All corfeia^ion factors. ttepend on 
n!en«:y ot tne H^^iodttJ iwage Honzonta! and verttca} S|>a{ri[! f orpisahon factors are reSated by ii " 
Gonsjafv'raspect VitoTacto?. 

Acccifdifjg to that, we soggest using Ihe Jaitowng forjr«jia so ca'cuiale ttw simuiBted gratn vaiue, 

« {e , L3 *« f X j y , c - 1 , t , & , 

where N is a rancJom valufe w«lh ftormaJisEed <3a«ss»ari d;l^rteu8oni A is a coRSlant pixel asjs^l ration i>, 
q, s and u ^ cotr^afeofi parameter*. Parameter y is siwEt)^ sDe«J fer tht first ce^w cha«mt, arwS 
gr^'n vafUf is'IsslOmeS^^ ineiex fe mitci range. 



; see also page 4 section "Noise intensity" regarding the dependency of the amount of 
noise on the image intensity). Gomila et al. also disclose the step of correlating the 



noise using a factor dependent on the temporal correlation of the current picture image 
with one of a previously displayed or decoded picture, (page 5 - emphasis added: 
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A& SAO s^i'^ *r<m -ife-uLk r*=' dl et^xijiK?ii ^^'St ^latrt va^ug^ ior -a gi'^^ pa^ ji^ a ^j^^^n oofs* 
(we»ss*^S X srKi V* When Jh«s ore«f ^mm&, m vwss rmm^ ^ ars 



). Gomila et al. do not explicitly disclose increasing the added comfort noise in 
accordance with a quantization parameter representing quantization of the incoming 



video stream. 



APA discloses increasing the added comfort noise in accordance with a quantization 



parameter representing quantization of the incoming video stream (Specification page 



6: line s 1 -2). Therefore, it would have been obvious to one of the ordinary skills in the 



art to include the decoder 12 of APA in Gomila et al. invention because it is a H.264 



decoder which is known in the art. 



Regarding claim 3. Gomila et al. and APA disclose as stated in rejection of claim 2 
above. Gomila et al. also disclose the correlation factor is established in accordance 
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with one of a luma or color component, (see "C" and "L" in "correlation parameters" in 



page 5, equation 2 - emphasis added: 



)■ 



Regarding claim 4. Gomila et al. and APA disclose as stated in rejection of claim 2 



above. Gomila et al. also disclose the step of adding noise to a color component of the 



picture in accordance with a luma component, (see "L" in equation 2) 



Regarding claim 8. Gomila et al. disclose a decoder arrangement for decoding a coded 



video stream to yield reduced artifacts, (page 2, lines 5-21 ; Examiner notes that the 
artifacts are the missing film grain in the decoded images because as described in page 



2 -emphasis added: 

s^j^t Is encode m ,m S£« me&s^ige dse^fied by a P^i^s&mmi Bxmmmi of JVT T?-^;,^, 
i Y r**.' i Q Ofcce^s if s^jife^ 2) Note th^j '^ua^^y *¥*P5s?T>«nt^d enr.^©? a nor^ 



i.e., the disclosed method by Gomila is well suitable for reducing artifacts), comprising 



the steps of: decoding the video stream (Figure 1" "Decoding"); comprising: a video 
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decoder for decoding an incoming coded video stream to yield decoded pictures (Figure 
1" "Decoding"); a reference picture store for storing at least one previously decoded 
picture for use by the decoder in decoding future pictures, (page 8 - emphasis added: 

Rg«f» S 3*KS«s mti tmmrt^^n ojrve <^tasn&<} toy fanning ^ m^m iecm 16 to 30. Th& 
roiiowjfig p«ram«it«rs were selected to configurs t?!® .-^^^t? 

GOP. 16 frames {{PBSPSaj 

Dtr©<St niwig typ«: spatja! 
Contest sfs't me4hcK3. sd^plsve 

Which means the used corresponding decoder (see the underlined encoder above) 
must have (implicitly) a reference picture (see underlined reference frame) stored as 
well, if it will be able to decode the bitstream successfully); a noise generator noise for 
generating random noise (page 5:, equation (2) where "N is a random value" in page 5: 
line 35) for addition to at least one pixel in a decoded picture (Figure 1 , "Film grain 
simulation"; page 3: line 27 "film grain simulation (decoder)"; page 5 - emphasis added 
Assumtn^j an aaeJHive ^min model, qmin sNnMlation changes each pixel value lo 

) 

in an amount correlated to luminance information of at least a portion of a current 
picture; (page 5 - emphasis added 
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Pages 



in 3 Jtrst approach, we jMropos© to use second otxter aula regressiort to mod^l spat«as correlation a*id 
'trst order regresstcjn to mode* cross-coJor and temporal ccsr^ationa. AU tayf^atsort ladcws degefsd on 
fij«nssiy of {i^e decodigfj tm^^^ HoftEOntal and verScai spaiia! cofreiation "fsctOfS ar® r^iietTb^a"" 
Gorisiiantaspeot ritiofg^^ " 

Mcofding to mat, v*e suggest ustng the foJiowin§ formwia to oatorfate the simuiaied grain vaiiie, 

whSffi N is a random vaJue w({»-» oormaitxed Gayswsn dfc^bufion. A is a constant pixel aspect ratio, p, 
q, J. $ and u are conrelatw parameters. Faramelef u is a^ys fer th* fsnst of^a^ chatme*, and " - 
S^^rt wrui'^ '3%~stimeS'^'M'0^'^ out of rmm. 



) using a factor dependent on the temporal correlation of the current picture image with 



one of a previously displayed or decoded picture, (page 5 - emphasis added: 



/t&&fmu Hi suggest u&^th^ mmm tmmM e»lc«ls^ ths sjf^syated ^^m. 

I ^il,Ji>>*tA*«?jj< i.,y l.<^,i. V. txt^,^ * 

v>^&-<& H «s» a jf^-<dc!f¥t vaiw i«^th ^(jnnasixsiJ Cau$^an d<ti«f*y!&on, A a mrssta^^.' aspect sSjs p. 
r. <sr)<* ,^f*.! < t r«, t ,0^ Vdf ir-yf^'&'-% P^fS M ts ali«?v^ys £^i> io' m« ttn\ mo <h^(>ml and 

As can bs sssn *r^>^^ tnt' ?s Uf ljS r-q*. ^t^-^f^ grShfi v^irti^^ f*?f i> qiwi^-* Ti**?* i 3 Ciu'fe'^ CO>0* 



) a noise picture store for storing the noise information for subsequent use by the noise 



generator (see "N is a random value" in page 5, lines 29-37 and page 6: equation 3; 
Examiner notes that the noise in spatial and temporal correlations of previously 
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calculated grain value of a pixel is used to generate the noise at the current pixel 
position, as disclosed in page 5: - emphasis added: 



8riS order r«i^«s«sson to mimi Ksm^<fm Wt^^ am^mm^ A» c«w«^?*dfs Jae^ m 
eefisJaf«; aspect raJsoJatt^jr. -v-v- 



AccciQ .1^3 to thai ^.j^qmt u&tnq tm^mt^^ tmmm t» tm^i^ m smM^ ^mti 

Sis U < y 1 i , 

whsm N ^ $ tmr^km M^m **th mmmi^ C&m^m d5«Sf«j*^n» A «s <s£>r>sJa«l f stss, p.. 

(t f . $ ©Hist « af« fiss«tsia5k»3: paramsf^. Pst^m^ u ts ittswasf^ fiw «i® <s:hanml, snd 

c&ktmm m mi^t im-'^mn^ I »V)5rs8-i kmrn, cater p*t>e««*«sS ssa-^S^f «Mr t<«R«asateii 



therefore, in order to enable the reuse of the noise it must be stored for every pixel, 
which means a noise picture store is implicitly (inherently) given); a summing block for 
summing the noise generated by the noise generator with a decoded picture from the 
decoder (see "+" in equations 1 , 2 and 3); and a clipper for clipping the summed noise 
and decoded picture. (Examiner notes that a clipper is implicitly present and inherently 
included, because the noise has a predetermined variance using such clipper, as 
disclosed in page 6 - emphasis added 



^^4% My csn is^k'ii to R, vs^tie S m v!fX^i!3rf^ste«^. as a rsswH grajr* ^ f;^e<9sv^ gray, )f^lkm m ^u® 
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Without clipper, tliere will be no restriction to the maximum value of the noise amplitude. 
Therefore, the noise, added to the decoded pictures, led to strong visible artifacts in 
dark and light regions of the output images. However, no such artifacts are visible in the 

images of Figure 8: 




(a) QP28 + film grain generated by tlie auto-regressive model 




(b) QP28 + film grain generated by filtering Gaussian noise 
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(c) Original 

This is due to use of tine clipper use). Gomila et al. do not explicitly disclose the decoder 

is generating a quantization parameter representing quantization of the coded video 
stream and the noise is increased in strength in accordance with an increase of the 
quantization parameter. 

APA discloses the decoder is generating a quantization parameter representing 
quantization of the coded video stream (page 5: lines 2529 of the specification) and the 
noise is increased in strength in accordance with an increase of the quantization 
parameter (page 6: lines 1-2 of the specification). Therefore, it would have been obvious 
to one of the ordinary skills in the art to include the decoder 12 of APA in Gomila et al. 
invention because it is a H.264 decoder which is known in the art. 

6. Claims 5, 6, 13, and 14 are rejected under 35 U.S.G. 103(a) as being 
unpatentable over Gomila (C. Gomila, "SEI message for film grain encoding", document 
JVT-I013r2, JVT of ISO/IEG MPEG & ITU-R VCEG, California, USA, September 2-5, 
2003) in view of Admitted Prior Art ("APA" hereinafter, "decoder 12" described in page 
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5: line 18 to page 6: line 4 of specification; also see "decoder 12 takes the form of a 
H.264 decoder known in the art" in page 5: lines 22-23) and further in view of Gomila et 
al. (C . Gomila and A. Kobilansky, "SEI message for film grain encoding", document 
JVT-H022, JVT of ISO/IEC MPEG & ITU-R VCEG, Geneva, Switzerland, May 23-27, 
2003). 

Regarding claim 5. Gomila et al. and APA disclose as stated in rejection of claim 2 
above. Gomila et al. do not explicitly disclose wherein the correlation factor is first 
established on an N. times. N pixel picture block basis (where N is an integer) prior to 
interpolation of the additive noise. Gomila, in the same field of endeavor (Examiner 
notes that the subject matter disclosed by Gomila is based on Gomila et al. disclosure - 
see page 1 , paragraph 3 of Gomila and page 6 of Gomila et al.), discloses the 
correlation factor is first established on an N.times.N pixel picture block basis ("...each 
block of 16x16 pixels..." in page 3, last two pars.). Therefore, it would have been 
obvious to one of the ordinary skills in the art to include the teaching of Gomila et al. in 
those disclosed by Gomila in order to generate the claimed invention with a reasonable 
expectation of success. 

Regarding claim 6. Gomila et al. and APA disclose as stated in rejection of claim 1 
above. Gomila et al. do not explicitly disclose the step of adjusting the noise based on 
the intensity of an N.times.N block (where N is an integer) of adjacent pixels. Gomila, in 
the same field of endeavor (Examiner notes that the subject matter disclosed by Gomila 
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is based on Gomila et al. disclosure - see page 1 , paragraph 3 of Gomila and page 6 of 
Gomila et al.), discloses adjusting the noise based on the intensity of an N.times.N 
block ("...each block of 16x16 pixels..." in page 3, last two pars.). Therefore, it would 
have been obvious to one of the ordinary skills in the art to include the teaching of 
Gomila et al. in those disclosed by Gomila in order to generate the claimed invention 
with a reasonable expectation of success. 

Regarding claim 13. Gomila et al. and APA disclose as stated in rejection of claim 8 
above. Gomila et al. do not explicitly disclose further including a second picture store for 
storing an N.times.N pixel block picture average, where N is an integer, for use by the 
noise generator. Gomila, in the same field of endeavor (Examiner notes that the subject 
matter disclosed by Gomila is based on Gomila et al. disclosure - see page 1 , 
paragraph 3 of Gomila and page 6 of Gomila et al.), discloses adjusting the noise based 
on the intensity of an N.times.N block ("...each block of 16x16 pixels..." in page 3, last 
two pars; Examiner note that the memory is implicitly included.). Therefore, it would 
have been obvious to one of the ordinary skills in the art to include the teaching of 
Gomila et al. in those disclosed by Gomila in order to generate the claimed invention 
with a reasonable expectation of success. 

Regarding claim 14. Gomila discloses a decoder arrangement for decoding a coded 
video stream to yield reduced artifacts (section 1 : par. 1), comprising: a video decoder 
for decoding an incoming coded video stream to yield decoded pictures; (section 3: par. 
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1 ); a reference picture store for at least one storing at least one previously decoded 
picture for use by the decoder in decoding future pictures, (page 5 - emphasis added: 

Which means the used corresponding decoder (see the underlined encoder above) 
must have (implicitly) a reference picture (see underlined reference frame) stored as 
well, if it will be able to decode the bitstream successfully); a noise generator noise for 
generating noise in accordance with decoded pictures (page 3: lines 1 -5, page 3: line 
28 , page 4, line 13) and bit stream information from the decoder for addition to at least 
one pixel in the decoded picture ("SEI message" in page 2: lines 1-3 is part of the 
bitstream) using a factor dependent on the temporal correlation of the current picture 
image with one of a previously displayed or decoded picture, (page 5 - emphasis 
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added: 



Jf5 3 s-'-j? <3p{j-oa«s^< we K> t&mm mms auto tsgt^ssw ^ tmss^^ ^jt^^m cofrs^lssicm snd 

U'A OffJc r8§) m Hi cr^m-^oksf and tfisrwaJ «sjflr«^f*s AS «x>r*^«?SQ!l factors ctep««jJ on 



«»'ns!<'<j M t;^ s mrt<iQfV: mih n-c!in^\^ii3c&d O^i^^^im distfa>ists£>f>> A a to^st^s^!t ssj?sl ssp^t rgjjo, p., 
^, f. snd u c©fr&*35«>r! j^ijrj3ifrwtf««s-$ P^ifgjTfs^ts*' 0 tt ith\^y^ i^ifK^ i'v fe-s.S ^^ra^J, af!4 ' 



) a picture store for storing an N x N pixel blocl< picture average, wiiere N is an integer, 
for use by tine noise generator, ("...each block of 16x16 pixels..." in page 3, last two 
pars.) a summing block for summing the noise generated by the noise generator with a 
decoded picture from the decoder. ("+" in equation (1); page 3, lines 1-5). Gomila do 
not explicitly disclose that the noise generator generates noise in an amount correlated 
to additive noise of at least one pixel in a prior picture. 



However, one of the ordinary skills in the art would recognize that the problem to solve 
by the claim invention is how to reduce the artifact of temporal flickering due to the 
added noise. Gomila et al., in the same field of endeavor (Examiner notes that the 
subject matter disclosed by Gomila is based on Gomila et al. disclosure - see page 1 , 
paragraph 3 of Gomila and page 6 of Gomila et al.) solve the problem by correlating the 
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amount of the current noise to tine noise of tfie previous frame using a temporal 
correlation factor v (Dl: page 6, lines 6-1 1). Therefore, it would have been obvious to 
one of the ordinary skills in the art to include the teaching of Gomila et al. in those 
disclosed by Gomila in order to solve the problem posed. Gomila et al. do not explicitly 
disclose the decoder is generating a quantization parameter representing quantization 
of the coded video stream and the noise is increased in strength in accordance with an 
increase of the quantization parameter. 

APA discloses the decoder is generating a quantization parameter representing 
quantization of the coded video stream (page 5: lines 2529 of the specification) and the 
noise is increased in strength in accordance with an increase of the quantization 
parameter (page 6: lines 1-2 of the specification). Therefore, it would have been obvious 
to one of the ordinary skills in the art to include the decoder 12 of APA in Gomila et al. 
invention because it is a H.264 decoder which is known in the art. 

7. Claims 7, 9, and 10 are rejected under 35 U.S.C. 102(a) as being unpatentable 
over Gomila (C. Gomila, "SEI message for film grain encoding", document JVT-I013r2, 
JVT of ISO/IEC MPEG & ITU-R VCEG, California, USA, September 2-5, 2003) in view 
of LeBlanc et al. (US 7,773,741 B1). 

Regarding claim 7. Gomila et al. and APA disclose as stated in rejection of claim 1 
above. Gomila et al. do not explicitly disclose wherein the amount of noise is correlated 
using an approximation of a Finite Impulse Response (MR) filter. However, use of MR 
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filter for correlator for comfort noise generator is well known in the art, as disclosed by 
LeBlanc et al. Therefore, it would have been obvious to one of the ordinary skills in the 
art to include the MR filter of LeBlanc et al. as the filter of Gomila et al. in order to 
generate the claimed invention with a reasonable expectation of success. 

Regarding claim 9. Gomila et al. and APA disclose as stated in rejection of claim 8 
above. Gomila et al. do not explicitly disclose wherein the noise generator implements 
an instantiation of a Finite Impulse Response filter. However, use of MR filter for 
correlator for comfort noise generator is well known in the art, as disclosed by LeBlanc 
et al. Therefore, it would have been obvious to one of the ordinary skills in the art to 
include the MR filter of LeBlanc et al. as the filter of Gomila et al. in order to generate the 
claimed invention with a reasonable expectation of success. 

Regarding claim 10. Gomila et al. and APA disclose as stated in rejection of claim 8 
above. Gomila et al. do not explicitly disclose wherein the noise generator implements 
an approximation of an Infinite Impulse Response filter. However, use of MR filter for 
correlator for comfort noise generator is well known in the art, as disclosed by LeBlanc 
et al. Therefore, it would have been obvious to one of the ordinary skills in the art to 
include the IIR filter of LeBlanc et al. as the filter of Gomila et al. in order to generate the 
claimed invention with a reasonable expectation of success. 
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8. Claim 15 is rejected under 35 U.S.C. 102(a) as being unpatentable over Gomila et 
al. (C. Gomila and A. Kobilansky, "SEI message for film grain encoding", document 
JVT-H022, JVT of ISO/IEG MPEG & ITU-R VCEG, Geneva, Switzerland, May 23-27, 
2003) in view of LeBlanc et al. (US 7,773,741 B1). 

Regarding claim 15. Gomila et al. and APA disclose as stated in rejection of claim 14 
above. Gomila et al. do not explicitly disclose wherein the noise generator implements 
an instantiation of a Finite Impulse Response filter. However, use of MR filter for 
correlator for comfort noise generator is well known in the art, as disclosed by LeBlanc 
et al. (US 7,773,741 B1). Therefore, it would have been obvious to one of the ordinary 
skills in the art to include the MR filter of LeBlanc et al. as the filter of Gomila et al. in 
order to generate the claimed invention with a reasonable expectation of success. 

Conclusion 

9. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nader Bolourchi whose telephone number is (571) 272- 
8064. The examiner can normally be reached on M-F 8:30 to 4:30. 

1 0. If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David. 0. Payne can be reached on (571) 272-3024. The fax phone number 
for the organization where this application or proceeding is assigned is (571 ) 273-8300. 

1 1 . Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
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published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at (866) 217-9197 (toll-free). 

/N. B./ 

Examiner, Art Unit 261 1 



/David C. Payne/ 

Supervisory Patent Examiner, Art Unit 261 1 



